Spiking Dynamics in Dual Free Layer Perpendicular Magnetic Tunnel Junctions.

Spintronic devices have recently attracted a lot of attention in the field of unconventional computing due to their non-volatility for short- and long-term memory, nonlinear fast response, and relatively small footprint. Here we demonstrate experimentally how voltage driven magnetization dynamics of dual free layer perpendicular magnetic tunnel junctions can emulate spiking neurons in hardware. The output spiking rate was controlled by varying the dc bias voltage across the device. The field-free operation of this two-terminal device and its robustness against an externally applied magnetic field make it a suitable candidate to mimic the neuron response in a dense neural network. The small energy consumption of the device (4-16 pJ/spike) and its scalability are important benefits for embedded applications. This compact perpendicular magnetic tunnel junction structure could finally bring spiking neural networks to sub-100 nm size elements.

Binding events through the mutual synchronization of spintronic nano-neurons.

The brain naturally binds events from different sources in unique concepts. It is hypothesized that this process occurs through the transient mutual synchronization of neurons located in different regions of the brain when the stimulus is presented. This mechanism of 'binding through synchronization' can be directly implemented in neural networks composed of coupled oscillators. To do so, the oscillators must be able to mutually synchronize for the range of inputs corresponding to a single class, and otherwise remain desynchronized. Here we show that the outstanding ability of spintronic nano-oscillators to mutually synchronize and the possibility to precisely control the occurrence of mutual synchronization by tuning the oscillator frequencies over wide ranges allows pattern recognition. We demonstrate experimentally on a simple task that three spintronic nano-oscillators can bind consecutive events and thus recognize and distinguish temporal sequences. This work is a step forward in the construction of neural networks that exploit the non-linear dynamic properties of their components to perform brain-inspired computations.

Energy-efficient stochastic computing with superparamagnetic tunnel junctions.

Superparamagnetic tunnel junctions (SMTJs) have emerged as a competitive, realistic nanotechnology to support novel forms of stochastic computation in CMOS-compatible platforms. One of their applications is to generate random bitstreams suitable for use in stochastic computing implementations. We describe a method for digitally programmable bitstream generation based on pre-charge sense amplifiers. This generator is significantly more energy efficient than SMTJ-based bitstream generators that tune probabilities with spin currents and a factor of two more efficient than related CMOS-based implementations. The true randomness of this bitstream generator allows us to use them as the fundamental units of a novel neural network architecture. To take advantage of the potential savings, we codesign the algorithm with the circuit, rather than directly transcribing a classical neural network into hardware. The flexibility of the neural network mathematics allows us to adapt the network to the explicitly energy efficient choices we make at the device level. The result is a convolutional neural network design operating at ≈ 150 nJ per inference with 97 % performance on MNIST-a factor of 1.4 to 7.7 improvement in energy efficiency over comparable proposals in the recent literature.

Influence of flicker noise and nonlinearity on the frequency spectrum of spin torque nano-oscillators.

The correlation of phase fluctuations in any type of oscillator fundamentally defines its spectral shape. However, in nonlinear oscillators, such as spin torque nano-oscillators, the frequency spectrum can become particularly complex. This is specifically true when not only considering thermal but also colored 1/f flicker noise processes, which are crucial in the context of the oscillator's long term stability. In this study, we address the frequency spectrum of spin torque oscillators in the regime of large-amplitude steady oscillations experimentally and as well theoretically. We particularly take both thermal and flicker noise into account. We perform a series of measurements of the phase noise and the spectrum on spin torque vortex oscillators, notably varying the measurement time duration. Furthermore, we develop the modelling of thermal and flicker noise in Thiele equation based simulations. We also derive the complete phase variance in the framework of the nonlinear auto-oscillator theory and deduce the actual frequency spectrum. We investigate its dependence on the measurement time duration and compare with the experimental results. Long term stability is important in several of the recent applicative developments of spin torque oscillators. This study brings some insights on how to better address this issue.

Vowel recognition with four coupled spin-torque nano-oscillators.

In recent years, artificial neural networks have become the flagship algorithm of artificial intelligence1. In these systems, neuron activation functions are static, and computing is achieved through standard arithmetic operations. By contrast, a prominent branch of neuroinspired computing embraces the dynamical nature of the brain and proposes to endow each component of a neural network with dynamical functionality, such as oscillations, and to rely on emergent physical phenomena, such as synchronization2-6, for solving complex problems with small networks7-11. This approach is especially interesting for hardware implementations, because emerging nanoelectronic devices can provide compact and energy-efficient nonlinear auto-oscillators that mimic the periodic spiking activity of biological neurons12-16. The dynamical couplings between oscillators can then be used to mediate the synaptic communication between the artificial neurons. One challenge for using nanodevices in this way is to achieve learning, which requires fine control and tuning of their coupled oscillations17; the dynamical features of nanodevices can be difficult to control and prone to noise and variability18. Here we show that the outstanding tunability of spintronic nano-oscillators-that is, the possibility of accurately controlling their frequency across a wide range, through electrical current and magnetic field-can be used to address this challenge. We successfully train a hardware network of four spin-torque nano-oscillators to recognize spoken vowels by tuning their frequencies according to an automatic real-time learning rule. We show that the high experimental recognition rates stem from the ability of these oscillators to synchronize. Our results demonstrate that non-trivial pattern classification tasks can be achieved with small hardware neural networks by endowing them with nonlinear dynamical features such as oscillations and synchronization.